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1.  Introduction.  Given  a  random  variable  X  and  a  function  g, 
crude  approximation  to  the  mean  and  variance  of  g(X)  are  obtainable 
by  Taylor  series  arguments.  The  variance  of  X,  a2,  is  a  key  quantity 
under  this  approach,  both  in  approximating  the  bias  (Eg(X)-g(EX))  and 
the  variance  (Var(g(X))).  For  X  positive  and  g  rapidly  decreasing, 
the  bias  and  variance  of  g(X)  should  be  relatively  insensitive  to  the 
tail  behavior  of  X,  and  a2  should  therefore  not  play  an  Important 
role.  In  practice,  when  a  is  very  large  the  approximations  for 

rapidly  decreasing  functions  are  often  very  poor. 

2 

He  take  the  point  of  view  that  or  is  not  measuring  that  aspect  of 
variability  which  is  relevant  to  the  behavior  of  rapidly  decreasing 
functions  of  X.  For  this  purpose  an  often  more  informative  measure 
of  variability  is: 

(1.1)  c 4  -  1-(EXEX  A) 

For  X  positive  and  g  completely  monotone  we  derive: 

(1.2)  0  <  [Eg(X)-g(EX)]/g(0)  <  c2 

(1.3)  Var[g(X)/g(0))  <  c2  . 

—1  —1  2 
Thus  if  EX  is  close  to  (EX)  (as  measured  by  c  )  then  for 


g  completely  monotone,  g(X)/g(0)  is  close  to  a  one  point  distribution 
at  g(EX)/g(0). 


* 


2 

The  quantity  c  has  an  additional  interpretation.  For  a  positive 
random  variable  X  with  distribution  F,  consider  a  stationary  renewal 
process  on  the  whole  real  line,  with  interarrival  time  distribution  F. 
Define  T  to  be  the  length  of  the  interval  which  covers  {0},  and 
V  »  T_1.  Then: 


(1.4) 


2  EXEX 


(EX) 


"1-1  EX"1  2 
2  EX  C 


(1.5) 


oJ/EV2  -  c2  . 


Moreover,  defining  h(x)  *  (EX)xg(x  1),  it  follows  that  g(EX) » h(EV) 


and: 


(1.6)  Eg(X)  -  Eh(V)  . 

Use  of  (1.6)  and  a  Taylor  series  argument  yields: 

c2  -I  3 

(1.7)  0  <  Eg(X)-g(EX)  <  j-  EX  sup(x  g"(*))  • 

X  fixed 

(1.7) 


Expressions  (1.2)  and  (1.7)  are  competing  inequalities.  For 
with  EX-1  <  08 ,  (1.2)  will  be  better  for  some  choices  of  g,  and 
for  others. 


4 


2.  Definitions  and  preliminary  results.  A  function  g  on  [0,®)  is 
defined  to  be  completely  monotone  if  it  possesses  derivltives  of  all 
orders  and  (-l)ng^  (X)  0  for  all  X  >  0.  In  the  above  g^  •  g. 

«]p 

Some  examples  are  (x+s)  with  a  ^  0,  k  >  0,  e  with  a  >  0,  and 

#-X(l-e  )  with  X  >  o.  Leans  (2.1)  below  is  due  to  Bernstein.  An 

interesting  discussion  and  proof  of  Bernstein's  theorem  is  given  in  Feller 
[2]  p.  439. 


I—  2.1.  A  function  g  on  [0,®)  is  completely  monotone  with 
g(0)  •  m  <  ®  if  and  only  if  it  is  of  the  form 


(2.2) 


g(x) 


r 

in 


e-XxdH(x) 


where  H  is  s  positive  measure  on  [0,®)  with  H([0,®))  -  m. 


Consider  a  probability  distribution  F  on  [0,®).  Its  Laplace 
transform: 

(2.3)  1(a)  -  ]  e^dFU) 

‘'0 

is  the  survival  function  of  a  mixture  of  exponential  distributions*  l.e. 
if  z|x-x  is  axponentlal  with  parameter  x,  then  Pr(Z>a|x-x)  »  e-01* 
and  Pr(Z  >  a)  •  Z(a) .  With  this  observation*  Lemma 
from  Brown  [1],  theorem  4.1  part  (xii). 


2.2  below  follows 


Lemma  2.2.  Let  it  be  the  Laplace  transform  of  a  probability  distribution 
on  10,*)  with  a  »  /”  X(a)da  <  *  and  y  -  (0)  <  *.  Then: 

(2.4)  0  ^JUcO-e”01^  £  l-(ay)  2  for  all  a  j>  0  . 

3,.  Derivation  of  inequalities.  Consider  a  positive  random  variable  Z 

.1  2  — 1 

with  a  -  EX  assumed  finite,  as  well  as  y  -  EX.  Define  c  ■  l-(ay) 

2 

Rote  that  0  c  <1  with  equality  if  and  only  if  X  is  a  constant. 

Theorem  3.1.  Let  g  be  a  completely  monotone  function  on  [0,*)  with 
g(0)  <  *.  Then: 

(3.2)  0  <  Eg(X)-g(y)  <  c2g(0) 

(3.3)  Var (g(X))  <  c2g2(0)  . 

Proof.  By  Lemma  2.2, 

(3.4)  0  <  Jt(o)-e"°y  <  c2  for  all  a  >  0  . 

Since  g  is  completely  monotone,  by  Lemma  2.1  there  exists  a  measure 
H  on  [0,*)  with  H(0,*)  -  g(0)  and: 

g(x)  - 


(3.5) 


[  e^dHfa)  . 


(3.6)  Eg(X)  -  jj  e^~dH(a)dF(x)  -  JsKa)dH(a) 


(3.7) 


g  (V)  -  e^dHta)  . 


Since  g  is  convex,  Eg(X)  >  g(y).  Thus  from  (3.4)  and  (3.6): 


(3.8)  0  <  Eg(X)-g(y)  -  J  (l  (o)-e“au)dH(a)  <  c2g(0)  . 

Jn 


Since  g  Is  completely  monotone  so  Is  g2  (Feller  [2],  p.  441), 
2 

Applying  (3.8)  to  g  we  obtain: 


(3.9) 


0  <  Eg2(X)-g2(y)  <  c2g2(0) 


From  (3.8)  and  (3.9),  Var(g(X))  -  Eg2(X)-(Eg(X))2  <  (g2(y)4c2g2(0))-g2(y> 

2  2 

eg  (0).  This  concludes  the  proof. 

Given  X  >  0  with  distribution  F,  consider  a  stationary  renewal 
process  on  the  whole  real  line  with  interarrival  time  distribution  F. 

Define  T  to  be  the  length  of  the  Interval  containing  0  .  It  follows 
from  Feller  [2]  p.  371  that: 


(3.10) 


dFj(x)  -xdF(x)/y  . 


From  (3.10)  we  see  that  ET  *  ■  y”*  and  ET~2  ■  ay”*  where  a  ■  EX-*. 
Defining  V  •  T~*  it  follows  that  a2  -  (ay-l)y-2  •  c2ay~*. 


while 


ay/EV  -  c  .  Also  from  (3.10)  we  see  that  Eg(X)  -  E(yVg(V_i))  -  Eh(V 
where  h(x)  -  yxg(x-1)-  Note  that  h(EV)  -  h(y-1)  -  g(EX).  Finally 
since: 

2 

(3.11)  h(V)  -  h(EV)  +  (V-EV)h'  (EV)  +  h"(V*) 

* 

with  V  between  EV  and  V,  it  follows  that: 

aj  2  -1 

(3.12)  Eg(X)  <  h(EV)  +  f  -  sup(h"(x))  -  g(y)  +  — ^  sup(h"(x))  . 

But  h"(x)  -  yx  3g"(x  1),  and  thus  sup  h"(x)  -  y  sup (x3g" (x) ) .  Thus 
from  (3.12) 


0  <  Eg(X)-g(y)  <  §-  a  sup(x3g"(x)) 


(3.13) 


•'  -1 
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